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ABSTRACT 

Research sought to determine whether memorization of 
rule statements before, during or after instruction in rule 
application skills would facilitate the acg uisition and/or retention 
of rule-governed behavior as compared to no-rule statement 
memorization. A computer-assisted instructional (CAI) program 
required high school students to learn to a pre-specif led criterion 
rhe application of five programing rules. Results indicated that rule 
statement memorization prior to rule application instruction did 
facilitate acquisition of rule-governed behavior. Despite this 
finding, however, no differences on a retention test in rule 
application skills could be attributed to the memorization of rule 
statements. (Author) 
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Effects of the Memor Uation of Rule Statements on 
PerforiTidnce, Retention, and Transfer in 
A Computer -Based Learning Task 

Nekon J» Towle 
' The Fu)r^da State UnTversity 

ABSTRACT 

This ^tv6y '^oughi to determine whether merhonzation of rule 
statements befc:'e-f du-'-ng, cr s^ter rriStructlon in rule application 
skM";s. wou'd ^dcHltdte ihe b^QUh ftion end/or retention of rule- 
governed behavicr as compa^'ed ^:c no ruie statement memorization » A 
CAI progrcm required hfgh ichocl is^tudents to learn to a pre-specified 
criterion the ajip^'icstion of^rive APL rules. Although rule statement 
memor"5 2.at1o<'i U'ricv to ruife appncatfon instruction did facilitate 
acquis^tiun oi ?e-gave.rned be.h^^lor, no differences on a retention' " 
test' in rule app1ic^t:'i>n sklTU could be attributed to the memorization 
of rule statements . 



INTRODUCTION ' 

Much of the instruction presented 1n today's public school concerns 
the acquisition of what Gagne (1970) has called intellectual skills. Probably 
the most conmon type of intellectual skill being learned in the schools is 
the acquisition of principles or rules. The learning and subsequent appli- 
cation of rules enables an indwidual to respond to a great variety of 
situations- in a regii^ar and effective manner. When a student learns to app'iy 
a Yute aod hi.> behav-;or becomes ''ule-governed, he may react-to situdtion*^; 
as classes of situations >^other than being required to meet each situdt:on 
a:} unique, kule- governed behev'ors then, is more efficient and effective 
than behavior that wou>d be required if there were no rules that qener-a^Aie 
tii mnre than on^ h iv.Ur?.t;Ofr . 

Since much of school-based learning involves the learning and appli- 
cation of y'u]es^ II is imperative that an instructional paradigm for the 
t(?achitiig and learr? [ng o^ i^u-es be both efficient in the short-term view of 
uic tt^'uction , and effective frj the longer-term view of retention and appn- 
cation cf learned rules in transfer situations. Several instructional 
psychologists have offered instructional sequences thought to be effective 
In the teaching of rules. Three of the better defined rule instruction 
models are presen1;ed below. 

Gagne (1970) suggests that an instructional sequence for the learning 
of rules should include the following ^teps: 

Step 1: Inform the learrfer about the form of the performance to be 

expected when learning is completed. 
Step 2: Question the [earner in a way that requires the reinstatement 

(recall) of the previously learned concepts that make up the rule. 
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Step 3: Use verbal stalijn^cnts Uues) that wTJ lead the '.ea-'^'er lo 

put the rule together a? a chd'^n cf concepts, m the pi'ope.r o'der^ 
Step 4: By means of a question, ask the '^ea.r'ne'^ to deTOOst^aie one 

or more concrete instance'.^ o** ihe ru"^ec 
Step 5: (optional, but usetu) for >ater instruction): By a suitable 

question, require the lea^ne/ to make a verbal statement of the 

rule.. 

Evans 5 Homme, and &)ase^ (.1962.), in deveuipuig a. s.y^^-t^.m ^ ; ' the 
construction cf programmed inst=^uct":on seque-^ces. for the '^ea;''n>.g c^' •••>^^e>. , 
recommend the fo Flowing sequence: 

1) Present a frame wh'ch ^nc^udes h verba* statement oT thfc rtje 
being learned, a complete F.A..inip e the rule, end ,7 pa'f oi 
example of the rule wh'.h -^equ're-f :T-ipcnse f^r^m the student, 

2) Gradually withdraw st'imj.U;: vupp^i^t. v^ith 'u^^e cr i rame;-; p^e.seoc-^r^g 
the rule statement and d pc.-t?^i example;, or a c-^<rt}.. -t^^e e>:^mp:e 
and a partial example, o-^ ? complete examp'^e and dP ; ^,';c'mp?.et:e 
rule statement, each requiring a response frcm the j^tudent. 

3) The instructional sequence should terminate when the student can 
deal effectively with a criterion test^'ng situation in solving an 
example problem or stating the rule wnh minimum stimulus support. 

4) When two or more rules are being presented, frames with incomplete 
rule statements and partial examples of each of the rules should 
be used to help the student discriminate between the two rules., 

In a proposed model for adaptive Instruction in rule teaching^ 
P. Fo Merrill (1972) suggests that the basic strategy would consist of a 
sequence of instructional frames that would employ a fading technique. 
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1) First, present a statement of the instructional obgective, rule 
statement, several examples along with explanations of why they 
are examples of the rule (prompts), several part^-al examples 
requiring an active student response, appropriate feedback con- 
tangent on student responses, and prompts after the student made 
the incorrect '^^esponser 

2) Same as (1) with the exception of deleting the prompts for the 
complete exarripies and different partia^r examples. 

3) Same as (2) except for deletion of a]] prompts, objecti\/e state- 
ment, and complete examples. 

4) Present complete example and several partial examples with 
accompanying feedback contingent on student responses. 

5) Present an example, -ncomplete rule statement, and contingent 
feedback 

6) Presenid t^.on of mcomp.iete rule statement with appropriate 
feedback. 

7} Present several partial examples along with feedback contingent 

on student responses. 
The P. F. Merrill model assumes that only the very low ability students 
would need to proceed through every frame in the sequence • Most students 
would be able to skip some of the fading frames, while very high ability 
students might be abV: to skip the highly prompted frames and some of 
•the fading frames^. 

One of the essential distinctions that must be made in the discussion 
of rule learning is the one between a rule as an Inferred capability or 
intellectual skill and the representation of a rule as a verbal 'statement 
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(Gagne, 1970), Gagne further suggests that, whi)e knowing the verbal state- 
ment doe< not necessarily mean understanding the rule, it is thought , equally 
important, to recognize that verbd*! statements usually enter into the pv^ocess 
of Teaming a new rule in a crucU'! wayc The verba) staiement of the rule 
communicates and Interrelates the concepts that the student must use or 
learn in ordev* to apply the ru^e under cons^deratTor. corv-ectly. Gagne 
further suggests that, while knowing the verbal statement does not necessarily 
mean linde/S'tand'-r.g the rule, \i thought equally ^mpoi^tant to i-'ecogn^ze 
that verbal statements usually enter into the process of ■iearn>ng a new rule 
in a crucial way . The verbal statement of the rule comfr-unicates and inters- 
relates the concepts that the student must use or lea-^n In order tc apply 
the >*u:;e urtder consideration co'^ ^'ectly „ Gagne proposes that a student may 
leavn a ru^e without learning tHe verbal statement of the^^i/ie* aU.houch 
the human adult often learns both, view. of the fact that the rule s.tate- 
ment may be used as a cue to the learning of the /u'^e Fu^'ther, the learner 
may a^so be able to demonstrate the rule at some later t^me w-thout being 
able to verbalize the rule statement or to recall it as a verbal statement. 

Each of the three rule instruction models presented above recommends 
that a verbal statement of the rule being learned should be presented at 
the beginning of the instructional sequence^ A, reason -for this procedure is 
that presentation of the rule statement at the beginning ^educes the risk 
of the student "discovering" an incorrect rule. The verbal statement of 
the rule also serves as a cue to learning of the new rule. AU three models 
also. include the learning of the rule statement as an integral part of the 
instructional sequence in teaching rule applicatlan skills 
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Though each of the three models inclides a requvement '^O'" the stu- 
:ent to learn the sta terpen t of the rule, this skill cannot be considev^ed 
as a demonstration of rule learning.. Gagne proposes that being able. to 
repeat the rule statement from memory would allow the student to talk about 
the rule on a later occasion. PcF. Merrill suggests that the ability to 
state the rule verbally may ser^e as a valuable cue and/or memory aid for 
subsequent application of the rule. Gagne would have the rule statements 
learned at the end of a sequence of instruction rather than the beginning. 
Both the P. F. Mervill and the Evans, et al models integrate rule state- 
ment me.monzation vjithin the :^/5e application instruction. 

The learning of rule appl ication skiUs. fo^ a one-time application 
\s obviously not an objective of the education system for students. The 
student must retain and be able to apply the rule -n transfer problem 
sowing situations to make the instruction worthwhile. Though generally 
recognized as important, many researchers v^eport a lack of retention in 
school learned subjects (e.g., Layton, 1932; Lahey, 1941; Smeit^^ 1955; 
Pre.ssey, Robinson, & He rocks, 1959) o 

Research in mathematics education and science education has indi- 
cated that intellectual skills such as problem-solving and rule-governed 
behavior are more resistant to forgetting as compared with lower order 
intellectual skills and verbal Information (Lahey, 1941; Layton, 1932; 
White, as reported by Lahey, 1941; Gagne & Bassler, 1963). Because rules 
and principles are highly resistant to forgetting, the inabi^nty to 
correctly apply a rule at a time some distance from the or ginal learning 
can be attributed to lack of retrieval of the correct rule rather than not 
having stored the rule in memory (Bruner, 1961). 
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That the problem of reti^ievai of information is as important as the 
initial storage of that information Is further expounded by Tulving and 
Pearlstone 11966). They have postuiated that retention performance is 
dependent upon both the degree of availability (available in storage) and 
the degree of accessibility (ease of retrieval) of the information required 
in the retention task. Studies cited previously have shown that rules are 
quite persistent in memory. Ifcould be assumed, then, that once a rule has 
been learned it has d'so been su^ed "'n memory and is available in memory 
for use at soire gemote Vm. The >"etrieval of this rule for use in a 
retention task is now dependent upon Hs accessibility, i.e., having the 
proper cues present to inuiate the systematic search necessary for its 
retrieval. Tulving and Pear^-tone conclude^ tha.t accessibility in recall 
of previous' .'.y learned Items o ^:nct1on of having an appropriate method 
to retrieve 'terns that tre retained. 

P. Merrill (19/2j suggests that the ability to verbalize the 
rule statement may serve as a useful cue for application of the rule in a 
retention task. The present study attempted to determine the effect of 
memorizing rule statements in an initial rule application instructional 
sequence on retention of rule application skills. Also, the effects of 
rule statement memorization on initial rule application learning and on 
transfer of the ruleapplication skills were investigatedc In addition, 
the present study, assuming that memorizing rule statements will affect ■ 
performance of rule application skills, sought to determine the proper 
placement of the memorization task within the instructional sequence. 



RELATED RESEARCH 



The literature review is divided into three sections . "^he fi'^st 
IS a description of the'concepto of Vale" and rule-governed behavior as 
held by several leading edticational "psychcloglsts ; The need is recognized 
^"or commonly accepted definitions of ' rule and rule-governed behavior .. 
The second section Is a summaryof the liter a tu-'e which investigates seve-'di 
important variables to be considered m the initiaMea^ning 'u^ies. The 
instructional task used in th s study was developed to promote ^n-^tial 
'lea/ning of the njles on the basis of these findings. The final sect'cn 

a summary c"^ the concepts of availability and accessibility »n memory o* 
P^ev^ously learned infcrmat^onc 

Ru'le and Rule-Gove-^ned Beh ayjoj^ 

In a sevies of papers ctjlminating in a thorough explication of his 
th'-nking in this asrea , Scandura (1972) deplores the ^ack of a commonly 
accepted definition as to just what rule-governed behavior is. Both 
Scandura (1972) and Gagne (1970) distinguish between behavior governed by 
a learned rule from the »^ule itself o Gagne states that a^ riile is not the 
verbal statement that simply represents the rule but is an internal state 
of the individual which governs his behavior^ Gagne defined a rule (con- 
struct) as: 

An inferred capability that enables the individual to respond to a 
class of stimulus situations with a class of responses, the latter 
being predictably related to the former by a class of relations 
C1970, p. 19], 

.7 
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Scandura proposes : 

A rule may be defined an ordered tripie (D, 0, R) where D refers 
to the deterimning properties of the stimuli, and 0 to the combining 
operation or transformation by wh?ch the derived properties (of the 
responses, R) are devolved fyom the properties in D [1970, p/520]. 

This could be expressed as the mathefnatical function R - 0(D), where D is 

the domain, 0 the function, and R the >^ange. Based on his extensive work 

in the concept>learning fie:d, M: D, Merrill defines a rule as: 

A statement of relatlonsh'ip between xwo or more concept classes 
[1971, p. 3/]. 

P. F. Merrill uses cornputev'-science terminology to define rule-governed 
behavior as : . 

The ability to perform a irpec-f^ed operation on inputs from a 
specified class of inputs to prc'duce a specific output from a 
class ot^ outputs- [1972, p 8?J. 

Clearly each of these educational psychologists is describing the 

same kind of behavior. Howe-.e", there is a neea for clarifying the def-i-^ 

nition of rule and rule-goveirned behavior. It will be helpful to consider 

■ three interre':ated concepts In order to more fully describe rule learning. 

These are the rule statement, the y-ule, and rule-governed behavior. A 

rule statement describes the procedure to be followed in performing a 

specified operation on inputs from a specified class of inputs to produce 

a specific output from a class o"^^ outputs. The rule is considered to be 

the procedure or operation described by the rule statement. Following 

this distinction, the comirson question "What is the rule?" should be stated 

as "What is the rule statement?" as the rule itself cannot be verbalized.. 

The rule exists in the abstract world and can only be inferred from the 

rule statement or by observing rule-governed behavior. Rule-governed 

behavior is that behavior that would result from a student correctly 

applying the rule. 

O 
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The ambiguous te^-m "rule learning'' may now be di^/ided into two 
app>'opriately descriptive terms: (1) Ifearmng the rule statement wh-ch 
''efevs to learning to verbalize the rule statement, and (2) acquT^sition 
of rule-governed behavior which refers to the correct application of the 
rule. A student has learned a rule statement when he can verbalize a 
statement containing (1) a description of all of the critical steps in 
the '^ule application procedure, (2) a description of the c! ass of inputs, 
cP.d (3) a description 0"^^ the class of outputs; This" ve^ba^i zed st<3te:men.t 
coold be in the. same form* as' it was presented to* the student o' it coi^^d 
be acceptable in a paraphrased form if it *ncluded the crUical aspects of 
the ''ule. For example, consider the APL function, The »^L;)e statement 
desrCi^'bing the function is "If V ts a st/ing of number's, (sum V) 
9''wes the sum of the numbers." An acceptable rule statement could be 
"■■/V means to add the numbers in the vector ^ togethe*^." Becat^se both 
r\j]e statements describe (I) the operatTon cr pi'ocedure (add, sum), (?,} 
the cUss o-f* inputs (string of numbers, vector), and (3) the c'.-.ss of out- 
puts ("ium), they would be equal ly acceptable as an 3nd?cat1on that the 
student had learned the rule statempnt. 

Rule-governed behavior may be demonstrated by using the rule to 
respond correctly to a rule application situation which has neither been 
previously analyzed nor seen analyzed by the learner, After a student 
learns the application of a rule, his subsequent behavior may be termed 
rule-governed behavior. Considering again the API function -f/j a student 
demonstrates rule-governed behavior if, when presented with the problem 
V 4 3 1, he responds "8\ Scandura (1972) makes the point that a student 
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may employ mere than one ^-ule to arrive at a correct response. Because 
this question is not central to this study, though important, it was. 
assumed that a student applied the rule in question if he responded 
correctly to two out of three of the unsolved problems" associated wUh 
the rule\ The response "8" P'^obably would not logically be associated 
with +/ 4 3 1 without the addition of 4+3+1. 

The Learning of Rules 

M, D. Merrill and Boutwe;] (1972) have developed an Interesting 
task content-student behavior cUssification system for classifying cog- 
nitive behavio/. The first dltrension, task content, refers to those charac 
teristics or a task identifying it as primarily a paired associate, con- 
cept, principle (rule), or problem taskc The second din)ension--student 
behav.'7or--*^ef?rs to the overt acts a student perfoi'ris and the conditions 
under which these acts must be observed before they can be termed dis- 
criminated recall, classification behavior, >^ule-using behavior, o^ higher 
order rule-using behavior. The boxes on the diagonal of Figure 1 are the 
categories developed from Gagne's types of learning by M. D. Merrill (1971) 
The other boxes indicate combinations of task content and student behavior^ 
In investigating the rule-using principle-content dimension categories, it 
is interesting to note that, theoretically, a student may use discriminated 
recall behavior to solve a problem in a rule-applying situation^ if he has 
seen that problem previously. 

The next step of the student behavior axis (classification) indi- 
cates that when given an unencountered instance of a particular class,' 
the student is able to indicate class membership. For instances of either 
the stimulus set or response set principle or problem classification is 
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Figure 1. Two Dimensional Task Classification - - Behavior and Content 

The diagonal (shaded boxes) are the categories included in the Gagne-llerrlll hierarchy 
(Gagne 1955, 1970; Merrill, 1971). Parentheses are Gagne's terms. Underlined words 
are suogested terms used In the Merrill-Boutwell paper to classify tasks in both 
dimensions simultaneously. 



Source: M. D. Merrill and R, C. Boutwell. Instructional Development: Methodology 
and Research, Working Paper No. 33. Brigham Young University, 1972. 
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frequently neglected in instructional programs. Students ave often able 
to use a given operation once a problem has been identified as a member 
of the p set to which the operation applies. But f'^equently they are 
unable to determine when to use a given operation, i^e., to choose the 
proper rule. The level of student behavior that ts mcst often considered 
when discussing rule or principle learning. is that of rule-using behavior. 
A student. has demonstrated rule-using behavior if, when given an unen- 
cobntered instance of a particular D set,, he can apply the operation 0 
• and produce the corresponding member of the R set. Obv-'ously, unless the 
student is told that the particular problem presented \s a member of the 
app!'cpriate D set, he must first perform a cUssif ication task by correctly 
^"dentifying the class membership cf the instance. 

Ve .^balizatlon of Rule Statements 

Gagne and Smith (1962) designed a sti/dy to im^estigate the role of 
verbalizing done by S_s during problem-sol ving s • tuatv<?n^. . Results indi- 
cated that $s who were 1nst:''iicted to say aloud their reascns for making 
each step In the solution to a practice problem reached a correct solution 
for the final task in fewer attempts than did Ss who were not required to 
v'erbalize. This difference increased as the problems became more difficult, 
In addition, those Ss who were required to verbalize their reasons for each 
problem solution step were able to formulate general principles of problem 
solution after correctly solving the final task problem better than those 
Ss not required to verbalize during the practice attempts, 

Seidel and Rotberg designed a study to answer '^n part the question 
"Does verbalizing the content of a rule where separably measurable from 
mediating responses aid or hinder a concept-lea-^ning and problem-solving 
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capability?.^' (Seidel & Rotberg, 1966). To explore the verbalization 
factor, one-third of 60 paid volunteer high school students wrote com- 
puter programs and periodically wrote out the content of the rules used 
to guide the writing of computer programs (rules group); one-third wrote 
computer programs and periodically .wrote down names they (students) gave 
the rules (naming group); and one-third wrote the computer programs 
without any verbalization of the rules {computer program only group). 
The task was presented via a programmed instruction text. 

Results of the Seidel -Rotberg study showed that the students who 
were required to give back the r^r^(^s in the words of the instructor 
(':n this case, the instructloral program) during the course of learning 
also were able to do this quite well on a criterion test. They, in fact, 
were able to assimilate and repeat the verbal material better than the 
other two groups noted as the naming and computer program only groups o 
As would be expected, the ru.as group took longer to complete the 
instructional material than did the other two verbalization groups. 
Further results indicated that the subjects required to write the content 
of the rules during training did not do as well in writing computer pro-, 
grams on the criterion test as the subjects who had simply to write the 
names of the rules during the training or the subjects who learned with- 
out either additional requirement. A retention test involving the 
application of concepts learned during the Instructional program in 
writing computer programs showed no statistically significant difference 
among the three groups . 



ERIC 



14 

Av al labii ity/Accessi bill ty of Rule s 

Bruner (1961) suggests that ihe principal problem of human memory 
is not storage, but retrieval. That we seem to be able to store a huge 
quantity of information Bruner Infers from the fact that recognition • 
(recal] with the aid of max?mum prompts) is so ve^y good in human beings, 
particularly in comparison with spontaneous recaU where we must retrieve 
stored information without external aids or prompts : Bruner indicates 
that the key to ret/ leva; ;S o^ganlzatfcn kncw:ng where to -^ind the 
-n^crmation and how to get there r 

In a /elated study reported by Tulv'sng ano; Pecr'stcne (1956) sub- 
jects learned on a single trial ^ists of wo^^ds- bebngfng to explicitly 
designated conceptual categories. Lists ve/^ed 1n terms of length (12, 
2A, and 48 words) and number of words per ccte^O'y {I, 2, end 4)o Immedi- 
ate "ecall was tested eHhe-^' ^n p''esence o- absence category names as 
'et-rieval cues. Cued recall was hi;gher then ncn-cued ^^eca'l, the differ- 
ence va-^ying d:;rect!y W" i:h \' bt length and in\e-'^e''y with number of items 
pe^ category^ This finding was ^interpreted by Tuning and Pearlstone as 
indicating that sufficiently intact memory traces of many words not 
recalled under the non-cued recall conditions were available in memory 
storage but not accessible for retrieval. Further analysis of the data 
in terms of recall categories and recall of words within recalled cate- 
gories caused Tulving and Pearlstone to suggest two independent retrieval 
processes. One is concerned with the accessibility of higher-order memory 
units and the other with accessibility of items within higher-order units. 
Organization of materials whether suggested by the experimenter or imposed 
by the subject, seems to affect »^ecall performance primarily by making the 
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desired information more accessible in an otherwise limited biological 
retrieval system. This organization need not have any effect on the 
availability of the information in the storage. 

In an unpublished study, Hannum (1972) reported that when a 
retrieval cue was used in conjunction with a retention test, performance 
in a rule application task was substantially improved. The effectiveness 
of the retrieval cue provides support for the position that intellectual 
skills are not forgotten or lost^ The lack of ability to retain or 
reinstate previously learned rule -governed behavior may be due to a 
faulty retrieval .scheme rather than a loss of the skill itself. 
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STATEMENT OF THE PROBLEM 



The learning that takes place in school settings rncludes the very. 
Important category of learning of rules. Rules are probably the major 
organizing factor and, quite possibly, the primary one in intellectual 
•functioning (Gagne, 1970). Rules guide the behavior of Individuals in 
n-eetlng many situations and In solving a va^^iety c*^ p'*oblems. The learning 
0^ a v^ule for a one-time spplication is obviously not an objective of the 
education of our schools. The student must retain and use the rule in 
retention and transfer p^oblem-sol'.^ing situations to enake the instruction 
worthwhile. As an attempt to further the gains aheaay mde in devising 
the best rule instruction paradigm possible, the present investigation 
attempted to assess the effect of learning verbal .staterrsents of rules on 
the 'initial learning, retention, and transfer of ru^e -go v^e/'ned behavior, 

Following Tulving and Pearl stone (1966) it was thought that rule 
statements having been previously learned would provide the cueing 
necessa»"y to increase the accessibility of the app^-oprtate rule -governed 
behavior in retention situations. It has been shown that the probability 
of the retention of once-learned rules is quite high. If behavior appro- 
priate to a rule is learned but not accessible in memory for a later 
application, the problem can be assumed to be due to improper retrieval 
from memory. Emphasis in this paper was placed on attempting to determine 

the contributions of the memo'^ization of rule statements to the acquisition 
and retention of rule-governed behavior. 
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Retention has also. been shown to be unrelated to ability or achieve- 
ment when the original learning is equalized (e.g. Klausmeier a Feldhausen* 
1959; Shuell & Kappel, 1970; Smeltz, 1955). By insuring within the instruc- 
tional program that all students perform to a prestated criterion, original 
learning by all subjects in this study can be assumed to be equated o Differ- 
ences occurring in retention performance can be laid to the difference in the 

experimental variable--that of memorization of a rule statement^ If, 

■ .1 ■ ■ . 

indeed, memorization of rule statements provides a cue for application o!" 
.'^u^es in retention tasks then the per-f'ormance of the Ss having memorized 
rule statements should be higher than the performance of Ss who did not 
memorize rule statements. 

The current investigation was undertaken to attempt to answer the 
following questions: 

1. Does the memorization of rule statements facilitate performance 
during the initial learning of rules? 

2. ^ Does the memorization of rule statements during initial instruction 

facilitate performance during a retention test in rule application 
skills? 

3.. Does the memorization of rule statements during initial instruction 
aid in performance during a transfer task? 

4, If memorization of rule statements during initial instruction 
facilitates rule application performance, at what point during 
the instructional sequence should the memorization requirement 
be made? 

5. . Do the experimental conditions interact with certain student 

abilities? 
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METHOD 

. Subjects 

' The subjects who participated in this study were taken from grades 
9-12. at the Florida State University Developmental Research School: The 
University School student body is composed of students drawn from the 
Tallahassee, Florida, community so as to accurately "eflect the charac- 
te-jstics of the community. The participants we«"e selected randomly from 
?he four grades depending upon the availability ot sti;dents as dictated 
by the University Schoo'f scheduler The data reco^'ded from eighteen Ss 
who did not complete all three phases of the study we^e discardedo The 
data reported are based on theji24 ^s who completed phases of the 
sti;dy« 

Aby h'ty Measures 

Several eminent educational psychologists have followed Cronbach's 
(1957) lead in promoting the search for student abilities, aptitudes 
(Cronbach & Snow, 1969), attributes (Tobias, 1970), or traits (AERA/SIG 
Individual Differences in Learning and Instruction, 1973) that interact 
with instructional treatments to produce different results depending on 
the level of the aptitude and type of treatment. On this basis, two 
ability tests were used to investigate relationships between cognitive 
'abilities and task performance « 

18 



ERIC 



19 . 

A series of studies by P. F. Merrill and his students (Merrill, 
1970;"Mernn, et al . , 1972; 1973) have produced results showing Aptitude 
Treatment Interactions (ATTs) in a rule-learning task similar to that 
used in this study, Fonowing the results of the P. F= Merrill studies, 
the Letter Sets Test from the Kit of Reference Tests for Cognitive Factors 
(French, Ekstrom, & Price, 1963) was selected as a measure of inductive 
reasoning. The Ship Destination Test from the same source was selected 
to measure general reasonlng- 

E xpe / i mental Task and Material s 

The learning task csed in this study was an adaptation of matei^ials 
based on the APL programming language used in several previous studies 
(Merrill, 1972). The use of the APL programming language as the basis 
to*'- the learning materials simplifies pretesting of subjects for prev^"ous 
experience with the language. Since the APL programming langu^age is 
currently used in some high schools and universities, the results of this 
study can be generalized to other instructional efforts dealing with 
quantitative subject matter. The learning task consisted of five modules, 
each based on one APL rule. Each module consisted, depending upon the 
group assignment, of a rule statement, examples of correct application of 
the rule, problems to which the rule must be applied to compute the 
correct answer, and, a requirement to memorize the rule statement. The 
results of previous research show that the first three rules are easy and 
the fourth^ and fifth rules substantially more difficult for S_s to learn^ 
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Performance Measures 

Rule application posttest and retention test . The posttest and 

retention test used in this study were essentially parallel forms in 
that both were composed of items that were sampled from the same pool 
of test items. The posttest contained a total of fifteen items, three 
Items for each of the five rules. A coding error deleted one of the 
items on the retention test for Rule 1 so the retention test was composed 
of a total of fourteen i terns , tv;o for Rule 1 and three for each of the 
other four rules. Copies of the posttest and retention test may be found 
m Appendix D, 

Rule statement retention test . The rule statement retention test 
asked for the statements of the rules to be applied In problem situations. 
Th'^s test was composed of five items, one for each of the rules. Each 
itam. had a possible score of ten points making a possible total score of 

fifty. 

Transfer task ^ The transfer task was composed or five modules, 
each based on one APL rule not presented previously. The program for each 
module of the transfer task required Ss to learn the correct application of 
one APL rule. A module consisted of one set of three examples of the correct 
application of the rule followed by three test items requiring correct 
application of the rule. As the purpose of the transfer task was to 
evaluate student performance rather than to provide instruction, no attempt 
was made to bring Ss ' performance to a minimum criterion level. The maxi- 
mum possible score on the transfer was fifteen. 
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Equipment 

The instructional program was written in the Coursewriter II 
language and presented to the subjects by the IBM 1500/1800 computer-' 
assisted instructional system at the FSU CAI Center. The learning 
materials and all tests in the APL-based instructional program were 
presented on the 1510 cathode ray tube (CRT). Employment of the CAI 
system in this study insured tight control over variable stimulus 
events for each subject that cou^d not be controlled in a regular 
classroom situation. 

Procedure 

The study was administered in three sessions including an ability 
testing session, the instruct iondl task and posttest session, and the 
retention test and transfer task session. The ability tests were 
administered to all subjects in one la>^ge group session and in one smaller 
group session, necessitated by the confines of the University School 
schedule. Immediately preceding the admin': strati on of the tests, a short 
explanation of the general purpose and schedule of the study was given to 
the subjects. The ability testing session (paper and pencil) lasted for 
about one hour. The instructional task session was presented by the CAI 
system in the FSU CAI Center. The subjects were randomly assigned to four 
groups^ The four groups were a No Memorization of rule statement group, 
a Rule Statement Memorization Prior to Instruction group, a iUile Statement 
Memorization During Instruction group ^ and a Rule Statement Memorization 
After Instruction group. 

Before receiving instruction in learning the APL rules, all Ss 
were presented with warm-up materials designed to familiarize each .S_ 

EKLC 
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with the operation of the terminal and to Indicate in advance of the 
presentation of the experimental materials what was expected of him 
during the instructional program. 

Each of the five modules of the rule application instructional 
program presented to all groups consisted of three levels of instruction 
in rule application^skills. The student was required to meet the mini- 
mum criterion performance of two-thirds of the rule application problems 
ccrrect on each level bel'ore moving to the next level = The supporting 
stimuli of the rule statement and accompanying examples were faded from one 
'ievel to the next until the criterion performance consisted or the presen- 
tation of a problem for which S was required to compute the correct 
answer without the aid of supporting stimuli. If the student did not meet 
the minimum performance i*equi rement of two problems correct out of the 
three that v/ere presented at any one level, he received up to four addi- 
tional displays of that level. When criterion was 'Reached at each of the 
three "revels of rule application instruction, Ss then received the instruc- 
tional module for the next task which depended upon the group to which 
was assigned. The warm-up materials and rule application instruction 
materials are presented in Appendix A. The modules were presented randomly 
until all five rules were learnedo 

Review tests were presented after the completion of the second 
module and last module. Each review test was composed of three test 
Items for each of the appropriate rules. Remedial review instruction was 
presented to those Ss not meeting the criterion of two out of three 
problems correct for each rule on the review test. After the remedial 
Instruction was completed the was then again administered the appropriate 
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review test. The review test and i^eview materials are presented in 
Appendix B. 

This basic sequence of instructional tasks »vas presented to ail 
Ss with the following exceptions. The Rule Statement Memorization Prior 
group was required to memorize the rule statement prior to receiving 
instruction in application of the rule. The Rule Statement Memorization 
During group was required to memorize the rule statement after reaching 
the criterion of two-thirds correct of the problems presented in the first 
level of rule application instruction. The Rule statement Memorization 
After group was required to memorize the rule statement after meeting 
criterion on all levels of appVcatlon problems associated with the ruls:. 
The Mo Memorization group was hot required to memorize the statement of 
the rule. 

The rule statement merrtcrlzation Instruction consisted of severa* 
levels of requirements on the part of the S_s to complete a rule statement 
by typing the appropriate woras Ui*nng the terminal keyboard. The supporting 
stimuli of partial rule statements and examples were faded until the cri- 
terion performance consisted of the presentation of a partial example for 
which S^ was required to type the statement of the correct rule to be 
applied. The rule statement memorization materials are presented in 
Appendix C. 

The instructional sequences for each of the four experimental 
groups based on this program for rule learning are presented in Table 1. 
Each line in the figure represents a frame composed of instructional 
components. 
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r 3(eg) + 3(eg -r fb) 
ru 3(eg + fb) 
3(eg + fb) 



No Memorization Group 
Instructional Sequence 



rv 3(eg) 3(eg + fb) 

ri> ^ eg + fiT fb 

eg ^ ru fb 

eg r ru + fb 

eg -t- ru + fb 

ru 4- 3 (eg + fb) 

3(eg + fb) 



Rule Statement Memorization 
During Group Instructional 
Sequence 



ru eg + ru + fb 

eg + nT + f b 

eg + nT -f fb 

eg' rtT + f b 

ru t 3(eg) -f 3(eg + fb) 

ru + 2(eq fb) 

3ieg^- fb) 



Rt'le Statement Memorization 
Prior Group Instructiotial 
. Sequence 



ru -r 


3(69) + 3(eg + fb) 


ru 


3(eg fb) 


3(eg 


+ fb) 


ru + 


eg + ru + f b 


eg + 


. — f 

ru + fb 


eg + 


ru + fb 


eg + 


ruT + f b 



Rule Statement Memorization 
After Group Instructional 
Sequence 



Table 1. Instructional Sequences Presented to 
Each of thp Four Experimental Groups. 



25 

The notation used in Table 1 is composed of coniponents adapted and 
extended by P, F„ Merrill (1972) from the Ruleg system (Evans, Homme, & 
Glaser, 1962). j These 'include: 

ru: Display of a verbal statement of the rule 

ru: An incomplete or partial statement of the rule which requires 

the student to respond by completing the rule statement 
'^'u: A terminal situation which requires the student to verbalize 

the rule statement with minimum stimulus support 
eg: An example of the ru!e 

"eg: An incomplete example or problem which requires the student 
to respond by, completing the example or solving the problem 
eg: A terminal situation where the student'is required to solve 
example problems with minimal stimulus support 
n(eo): A^ series of n examples of the same rule 

fb: Display of feedback concerning the correctness of a student's 
response to a problem or partial examp'ie 

The instructional sequence consisted of the successive display of 
frames beginning at the top and proceeding to the bottom of the figure. 
The supporting stimuli such as rule statements and examples were faded 
"gradually until the student was able to solve problems and verbalize the 
rule statement (if applicable) with minimal support. Figure 2 presents 
a flow chart depicting the entire instructional program. 

Two weeks after the instructional session the subjects returned to 
the CAI Center to receive administration of the retention test and transfer 
task. The transfer task was composed of five additional APL rules that 
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Q START ^ 



InfOTOition 




ft 

3 Examples 



3 Prohleflu 




Rule N StAtcfnent 
3 Problem 




Figure 2. Flowchart of the Instructional Program 
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mre not presented previously. The sequence of Instruction in the transfer 
task paraUeled that of . the Initial instructional task presented to the no 
rule statement memoHzation group with the exception that no rule statement 
was presented. 

Dependent Measures 

In addition to scores on the two cogniti^'e ability tests, posttest, 
retention test, and transfer task described in previous sections, data 
were obtained for each during the r^jle appncaCion !astructdQn program 
cn the following cri-teria: aisplay latency, sample lest iitem response 
larency, and number of sample test items attempted before meeting the 
m^ctmLm performance crite.ncn required by the program. Display latency 
was the measure of the time between the initial display of study material 
and the start of the display the first problem of that, level of ins true- 
t'cn.. ^Sample test item response latency was the time between the initial 
ojspiay of a test item and the answering of that test item imbedded within 
the rule application instructicn. 

Data were also collected on the total amount of time required for 
each to complete the instructional program including the rule statement 
memorization instructional materials. This total instructional time did 
not include the time required for testing activities ^ 

De sign and Analysis 

The data presented in the Results section were collected on the 
performance of four treatment groups: the No Memorization group (n = 32), 
the Rule Statement Memorization Prior group (n 33), the Rule Statement 
Memorization During group (n - 29), and the Rule Statement Memorization 
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After group (n = 30), Two designs were used for analysis of the data 
depending upon the dependent measure under examlnationo A four inde- 
pendent group design was used for the analysis of test scores and a four 
group by five repeated measures analysis of variance. was used to evaluate 
several of the within instructional task measures. Other data were 
evaluated using two-tailed t tests. A positive bias correction w.as 
applied to those degrees of freedom used to test repeated measure factors 
when appropriate in ANOVA (Greenhouse & Geisser, 1959) . The alpha level 
for statistical significance was .05. 

Analysis of Aptitude by 

Treatment Interactio ns . . 

To investigate the presence of Aptitude by Treatment Interactions, 
the relationships between scores on the two ability measures and task 
performance scores were operationalized in terms of the slope (amount of 
change in the criterion per unit change Ij the covariable) of the regression 
lines for each of the t/eatme^it groups, Llnea-^- regression analysis 
(Bottenberg & Ward, 1953) was used to evaluate the relationsliips between 
aptitude and perfo^^lance^ The procedure for computation of the sta- 
tistic and a description of the mathematical models used in each test are 
presented in Appendix E. ••■ 
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RESULTS AND DISCUSSION 



A summary of mean percentage correct on the ability tests and on 
the task performance tests is presented in Table 2. All groups performed 
similarly on each test with the exception of the rule statement retention 
test where, as would be expectedj the group that was not required to memo- 
rize rule statements per^omed less well than the rule statement memori- 
zation groups. All groups performed at a higher ievel on the rule appli- 
cation posttest than was required within the instructional prograrrK -81-88% 
on the posttest as compared to 67% required in the instructional program,' 
Perfomance of rule-governed behavior on the rule appVicaticn retention 
test was somewhat lower than that on the posttest bi't substantially higher 
than that cn the rule statement retention test. Th^s result is consistent 
with results of previous research indicating that intellectual skills such 
as; rule-governed behavior are more resistant to forgetting than memorized 
verbal information (Lahey, 1941; Layton, 1932; Gagne & Bassler, 1963), 

Analysis of variance F_ ratios for the instructional task test scores 
are also reported in Table 2. Table 3 presents a summary of the £ ratios 
resulting from linear regression analyses used to investigate possible 
Aptitude by Treatment Interactions. A detailed discussion of the analyses 
of each dependent measure is presented in the following sections, 
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Po sttest Score 

Since the experimental procedure requii^ed all Ss to perform at a 
rrlnjmum criterion level on each •"ule module before pi^oceeding to the 
next, no significant treatment diffei^ences were expected in mean post- 
test-scores. The results from.ANOVA suggest that the mino>^ difference 
in treatment group posttest means was due to chance ^ 

Figures 3 and 4 illustrate the different relationships between 
"easonlng ability test scores and. posttest scopes in the ^ocir treatment 
groups. There was a greate^^ positive relationship, as illustrated by 
the greater positive slope of the regression -^ne, between general 
•easoning ability as indicated by the Ship Dest^^nation Test scores and 
posttest performan^ce in the Rule Statement Meirc^r ization After group than 
the three other groups. Similar results we<e found using scores from 
the Letter Sets Test as covar^'able and posttest sco^^es as crltev*lon: 
Th.ese results are somewhat surpnsing as the Instructional program for 
learning rule-governed behavior was the same fo^' the Role Statement 
Memorization After group as tor the No Memonzaticn group. Yet, the 
i^e !at1onshi p between reasoning ability and posttest performance was 
greater for Ss in the Rule Statement Memorization After g^oup than for 
Ss in the No Memorization group« Apparently the requi'^ement of memorizing 
a rule statement after having mastered the behavior required by the rule 
increases the relationship between reasoning abiMty and performance as 
compared to not being required to memorize the rule statement at alK 
The posttest performance of those Ss memorizing ^ule statem.ents prior to 
receiving instruction in rule application skills was related very little, 
as illustrated by the nearly horizontal reg^^ession line, to reasoning 
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3. Interaction of Ship Destination Test Scores and Treatments with Post test Score as Critcrl 
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Figure 4. Interaction of Letter Sets Scores and Treatmeits with Posttest Score as Criterion 
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ability as was the posttest performance o^' those Ss not required to memo- 
rize rule statement. The reiatlonship between posttest perfomance and 
reasoning ability o*^ Ss '^n the Rule Statement Memorization During group 
is of little interest other than that it was between that of the Rule 
Statement Memorization Afte-- group and that of the No Memorization group. 

Rule Application Retention Test Score 

The expected s;gn:f fc^'nt dif ferentf^l effect of the treatments on 
performance on the rule app" -cetkr; retention test was not supported by 
the data. One e/pianct^on for this res-ult m:=ght be that the inst-'uctional 
program was equally erfective ' n teach";nQ aM Ss the appi^opriate ru-ie- 
governed behavn'o^ on a high perVc^mance ■eve: ^ega^'dless t-^eatment 
group. This ruie-go e'ned behavior was then ^^etamed tc a relatively 
high degree ov'e>^ the two-week per iod between the p'esentation of the 
instruction and the admunst^ation of the etention test.- In •'af:t, the 
mean score fo^* o\ i treatment c,;cv:.p.s neevly meets the pe/^cr-'^'ance le^e^ 
required by the 'instruct^oni* ! prog/cm. Several other reasons for the 
lack of treatment effect on retention of rule-governed behavior will be 
presented in a later section. , 

Figure 5 illustrates the relationship between Ship Destination Test 
Scores and rule application retention "test scores for each treatment group. 
As with the posttest scores, the retention test scores were mere positively 
related to^gene^al reasoning ability 1n the Rule Statement Memorization 
After group than in the othe^ three groups. 
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Rule Statement Retent tc n Test Sco^e 

The rule statement retention test ^equv^ed each to type the 
statement of the ^\j^e that would be used to cornpute the correct answer 
to each of five problen-is, each pz-ob^^em -ep^esenting one of the previously 
learned APL rules • These staten-'ents were ew'a'uated independently by two 
expert APL p/og^a™e^s , A co^^ect -^iZ-e statement was awarded ten points 
with fewer points being given fo' pe^t ^-l^ cc<^ect answe^^s. The pro- 
duct mcrent cc^re^at'on between the t'^tc "^cces ewa^ded each _S by the 
two eva'luato/s was -94 wh^jh :ndv^ar;eo a high deg-ee ot scoi^^ng con- 
sistency between evd'iuar.o s . for- pi.-'pcses of further analysis, the 
average of the two toto' sco-^es fo- eoch ^ wo- i^sed.. As reported in 
Table 2y analysis c/ va^:ance evea'cd ^ s^^gni -^Tcent treatment effects 
Subsequent t_ tests.- - evea:.ed no ign ' M..on pe; formqnce differences between 
the three rule staterr^ent afemo' ^ 7aT^ on g^o-ps , c- between the Rule State- 
ment Memorization Diz-^-ing g-oup ond the No Memorization group- However, 
mean scores indicated s ? gn"; I* ■.rantly lower sco'^es for S_s in the No Memo- 
rization group than Ss in the Rule Statement Memorization Prior group 
(t 2.39, df = .120, ^ < .05) and ^o^ Ss in the Rule Statement Memorization 
After group (t - 2,79, d± - 120, < .05). 

Though Ss in the No Memor-ization group were not required to memorize 
r^ule statements at any t-itie, the^i^ pe^-fo^mance on the rule statement reten- 
tion test did indicate that they cou!d give minimally correct rule state- 
ments two weeks after rule appl-^cation instruction. Surprisingly, the 
performance of Ss in the Rule Statement Memorization During group was not 
slgnif-^xantly d^:fte^ent from that of Ss in the No Memorization group- All 
Ss who me.morized the ru^e statements during >^'ule application instruction 
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did, in fact, memorize the rule statements just as thoroughly as Ss in 
the other two rule statement n^mO'^i25tion groups but at a di-f'ferent point 
in the total instructional program. The interruption of rule application 
instruction to fulfill the rule statement memorization •-equirement and then 
the subsequent return to the rule application instruction seems to have 
debilitated Ss ' ability to restate the rule statement on the retention test. 

Transfer Task Score 

Though Ss in the Ru^.e Staterr-ent Meniorizat'»on Prior and the Rule 
Statement Memori zati on After groups pe/'forn-ed better on the t^^ansfer task • 
than did the other two groups, these differences were not significant: 
Figure 5 illustrates the differenti a! '^e'ationsh" ps between reasoning 
ability as measured by the ShTp Destinaticn Test and transfer task sco>'es. 
Though the slopes of the regression lines are slightly greater for all 
groups than those of the posttest and retention test scores, these regres:-. 
sion lines -follow a pattern slm^lU'^ to those for the posttest scopes and 
retention test scores. The reiationship between reasoning ability and 
performance on the transfer task is greater for Ss in the Rule Statement 
Memorization After group than for Ss in the other three groups « The 
effect of memorizing rule statements after reaching- mastery on rule appli- 
cation skills seems to cause Ss to have a greater reliance on reasoning 
ability to perform on the transfer taskr 

Number of Rule Application 
Sample Test Items Attempted 

The number of sample test items attempted during the rule application 
instruction is a gross measure of the subject's performance in the instruc- 
tional program. The number of sample test items required to meet the 
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No Memorization 

^u}e Statement 

Memorization Prior 

Ru]e Statement 

MejDorization During 

Rule Statement 

Memorization After 



^ 12 15 

SHIP DESTIHATION TEST SCORE 



18 



21 



n«.r. a. z«U,r.«,o„ 0. S.1P 0.st.«Uon T„t Sco™. rr«U.nt. with Tr..,.. t«. Sco. « CHUrlon 
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minimum performance c^ite-^ion is d^.recVy -^e^ated to difficulty S bad 1n 
mastei^lng the instr-uctlonal fr.ate-'^ als . ^he m^rnmum numbe^ o^ sample test 
iterris that any S^wouUj hc.vc. recei\/ed was +o?^ty-five.--th^ee for each oi 
th^^ee levels oT the t;i/e 'ule modules. Of ivedt ^nte^-est are the standa^'d 
de\/iat!ons of the Rule Statement Memorization ^^^of gj^oup (see '^able 4) - 
The instructional p-og-dm presented to Ss ^n th^s f^eatment g-^oop produced 
rule-governed beha\ :0< so uniformly good that the va'^iablHty was reduced 
to the po.nt whe e. a«^'c''y^:]5 ct va^'Tance or :his data m^gbt be cons^de^^ed 
to be " napp'GpMate *^he -^ange ot nurrbe^ ct samp-e rest items attempted 
by Ss ni the Rii\e Statefrent Memorization k-^jv g.-cup was 45-5^ with a 
mean of 46^6, The -ancles o** sc^rp.e test •tern'- to' the No Men-ic *?2at";on 
group* the R'^le Stateaent Memc^^^zaf on Db-'nc^ g-O'/p, ana the Rule State- 
Tent MemoMZatton A^.e^ g^o-.p we.^e 45-i^4i - ^S-iESs and ^5-115 ^espect^ely . 
F'C'T thl£- ev'Jdence *t wou id seem S6*e to Lonclooe that requ*!-ing iremo^i- 
zation 0- ^u^e statements p^'^O' tc ^y/le appMcatlon :nst'uction s the best 
of the foi^^. - r st- ti onai ^t^at^gles to fac;Vt-:.te unito-^miy good rule- 
governed behav/ior with a minimum number of practice test i terns t 

"Though It IS recognized that £ ratios obtained from analysis of 
variance of these data may be suspect due to the )ack of variability of 
scores in some of the ceP.s and the 'ack of homcgenity of variance across 
cells a 4 group x 5 Rule (repeated measures) AN.OVA was performed. As would 
be expected from an e^^ami nation of the means \n Table 4 the results of 
this ANOVA revealed sf gni+^icant Treatment and Rule factors (see Table 5), 
The mean number of sample test Uems Indicate that the Rule eMect was due 
to the increased number ot sample test items attempted ]n the more di-^ficult 
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Table 5 

Analysis of Variance Summary for Number of 
Rule Application Sample Test Items Attempted 



Source 


df 


MS 


F 


Treatment (T) 


3 


175.7 


2.908* 


S^s within T 


120 


60.8 




Rule (R). 


(4) 1^ 


532.3 


18=939** 


T X R 


(14) 3'' 


60,1 


' 2.139 


R X S^s within T 


(480) 120a 


28.1 





^ df reduced by a factor of '. where b = number of repeated 

b - 1 

measures (5) according to Greenhouse and Geisser (1959). 
* p < .05 
** p < .01 
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modules for Rules 4 and 5^ Analysis of variance on the number of sample 
test Items attempted in each rule module revealed a significant Treatment 
effect in the Rule 4 module (£ 2.773, df^' 3/120, 2. ^ '05), Subsequent 
t- tests revealed that Ss in the Rule Statement Memorization Prior group 
required fewer sample test items to meet the minimum perfomiance level 
ci^iterion than did Ss in the No Memorization group (t_ = 2-675 df_ = 120, 
£ < .05)5 the Rule Statement Memorization doring group { - 2. 05, 

- 12.0, < .05), and the Rule Stateirent Memonzatlon After group 
( t ^ 2,21, dh[ = 120, ^ ' e05). There weve no significant differences 
between the performance of the othe^ ih-ee groups in number of sample test 
Uems attempted in the Ruse 4 module 

Linear regression analysis was employed to probe for possible ATI. 
e'^'iects on the number of rule apph;cat'^ori sample test items attempted^ 
Figure 7 iUustrates the signh'cant mte-^dct^on between Treatment and 
Sh;p Destination Test scores us:rg numbe;^* oi sample test ?tems as cri- 
terion. Figure 8 shcv/s the p.ots or the v-eg-'ession lines illustrating 
the significant interaction between Treatment and Letter Sets Test scores 
with number of sample, test items as crite-^lon. Both figures show that 
number of sample test items has a high negati^/e relationship to both 
general reasoning ability and inductive reasoning abil 1ty for Ss in the 
Rule Statement Memorization After groupo This relationship is also 
present for Ss in the otbe>^' groups but tc a lesser degree. In fact, this 
relationship was substantia lly reduced for Ss 1n both the No Memorization 
group and the Rule Statement Memorization Prior group. The similarity in 
slopes of the regression lines for the latter two groups should be 
(interpreted in I'ight of the significant Treatment effect whereby the 
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Figure 7. Interaction of Ship Destination Test Scores and Treatjents with 
Nuirtber of Rule Application Sample Ttst Items as Criterion 
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inctructional program for the Rule Statement Memorization Prior group 
reduced the mean number of sample test items required to meet the minimum 
performance criterion required of all S^s ?n rule-governed behavior, 

R u^e Application Display Latency 

Another dependent measure used as an indication of Ss performance 
m the instructional program is display latency. The amount of time that 
the Instructional materials are displayed 1s directly related to the diffi- 
cu- ty _S had in learning -^ule-go^^erned behavior. As would be expected , mean 
display latency increased from about thirty seconds for each of the three 
previously demonstrated easier rule modules to about three minutes for each 
of the two more diff'cuU. ''u]e modules (see Table 6)0 The instructional 
p'ogram which required Ss to memorize ru)e statements prior to receiving 
instruction in rule-gover-ned beha\^'^o^ fdcintated learning ot rule appli- 
cation skills such rhat "it produced unifoi^mly low requirements for study 
f:me as compared to the instructional programs for the other treatment 
g"rcups. When display latency for each of the five rule modules was totaled, 
the total display latency variance fo^ the Rule Statement Memorization group 
was significantly less than the variance for the No Memorization group 
(F 5.42, df = 31/32, p < .01), the Rule Statement Memorization During 
gr'oup (£ ^ 1.11 ^ df^ ^ 29/32, ^ < .05), and the Rule Statement Memorization 
After group (F = 2,84, df ' 28/32, ^ < .01)= Though the measure of display 
latency is not as important as other measures^ reported in this paper, these 
results do give further evidence as to the effectiveness of the instructional 
prog 1^ am for the Rule Statement Memorizatton Prior group in facilitating the 
acquisition of rule-governed behavior. 
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Rule Application Sam ple Test 
Item Response Latency 

One additional measure used to indicate Ss' performance^ within the 
instructional pvograms is the amount oT time takes to respond to the 
sample test items. Although this measure was highly related to the number 
of sample test items attempted (product moment correlation of ,72), it 
does give additiona! information of the effectiveness of the instructional 
programs. Consistent wtth the /esu^ts of the analyses of several other 
dependent measures, the • nstructiona- program for the Rule Statement 
Memori^zati on Prior yroup s'jgp.^ ficeniiy reduced variability in total test 
item response latency as compered with the programs for the No Memorization 
group (F; = 7.7, df ?1, 32., ^ < .01), the Rule Statement Memorization During 
group (£ 5.03, 29/32, £ < .01), and the Rule Statement Memorization 
Alter group (F_ 6,42: dr ^= 28/32, £ < .01) > As depicted in Table 7, the 
rrean sample test I'tem response latency for Ss in the Rule Statement Memo- 
rization Prior group was consistently Hess than that for each of the other 
three groups on each rule module. Mean tota ; Sdmple test item response 
latency indicated less time necessary to respond to test items for Ss in 
the Rule Statement Memorization Prior group than for Ss in the No 
Memorization group (t - 3,502, df - 63, £< .05), and Ss in the Rule 
Statement Memorization During group (t_ --^^ 3.168, df = 61, £< .05). 
Although not significant at the alpha level of .05, the difference between 
performance of Ss in the Rule Statement Memorization Prior group and Ss in 
the Rule Statement Memorization After group (t -'^ 1.67, df 62, £p^.lO) was 
in the same direction with Ss mem,orizing rule statements prior to rule 
application instruction requiring less time to respond to. the sample test 
items imbedded in the ^ule application instruction materials. 
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Whils evidence has been presented that consistently supports the 
effectiveness of the "insti^uctlonaT program requiring .memori zation of rule 
statements pfio^ to rule application Instruction in facilitating the 
acquisition of rule-goveriied behavior, the following measure will give an 
indication of the efficiency of the total instructional programs including 
the rule statement memorization program. 

T otal Instructiona l Time 

The total time, e^clud^ng testing tiirie, required by eech _S to 
complete the ins.t; i>c:^t^ond^ p'og^am, including both the sections on rule 
application and on "u ie sx.atement memorization was recorded as a measure 
of the overall ef-fk;;ency cf the total program^ Mean times for the No 
Memorization group, the Rule Statement Memorization Prior group, the Rule 
Statement MemoHzation Du-ing group, and the Rule Statement Memorization 
After group were 2.1^ 53, 60, and 50 minutes respecti \/ely « The rule 
statement memo'^-uation g'oups reqqned substantially more tim.e to complete 
the inst'-'uctional program than did the group not. required to memorize 
rule statements. As the three rule statement memorization groups not only 
mastered rule-governed behavior but also performed the additional task of 
memorizing the rule statements, this finding is not at all surpv^isingo 
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CCNCI,.US1.0NS AND IMPLICATIONS 



In an introductory section of this paper it was proposed that 
the memorization oi /ule statements would increase the accessibility 
of previously learned ru^e application skills and, therefore, facili- 
tate performance on a retention of rule applicati-^n skills tasko It 
was also anticipated that the memo^^ization of rule statements prior 
to rule application -.nst n/ction would facilitate the acquisition of 
rule-governed behavior by reducing the number of sample test Items, and 
also reduce the amount of time taken in responding to sample test -items. 

It was further expected that memorizing ^^ule statements would 
compensate for low inductive reasoning and general reasoning abilltj^ in 
performance during the learning task and in subsequent test situations™ 
This effect would be evidenced by a :^educed relationship between the 
reasoning abilities and task performances. 

The design of the present study was such that all S_s were required 
to reach a minimum criterion performance at each instructional level of 
the task before they were allowed to go to the next level. The applica- 
tion of each rule was mastered before going to the next rule. This pro- 
cedure was used to assure that all treatment groups would perform at the 
same level on the posttest * Unless all. groups learned the original task • 
equally well , any differential performance on retention or transfer 
measures could not be attributed to the effect of rule statement memori- 
zation on improving accessibility of rule application skills. The results 
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indicated that mean differences on the posttest were due to chance« There- 
fore, it was concluded that all groups had learned behavior governed by 
the five APL rules equally well. Because overall performance on the post- 
test- was better than the two-thirds correct required by the instructional 
program it was then concluded that the instructional program was effec- 
tive in producing S_s who could exhibit the appropriate rule-governed 
behavior. 

The expectation that the groups memorizing rule statements would 
perform significantly higher on the retention of rule application sk^'fls 
test was not supported. This may be due to three factors. First, since 
there wa^ a small decrease (20-30%) in performance between the posttest 
and retentioii test for all treatment groups, the retention interval of 
two weeks may have been too short for the effects of memorization of 
rule statements to be seen 1n retention of rule application skills. A 
second factor relates to the proficiency in rule application demonstrated 
by S^s after completing the Instructional program. The success of the 
computer-presented instructional program in promoting this high level of 
performance in all experimental groups may have prevented the memoriza- 
■ tion of rule statements from differentiany affecting performance in re- 
tention of rule application skills. Thirdly, the relatively poor per- 
formance exhibited by all Ss on the rule statement retention test indi- 
cated that the rule statements were not easily accessible in memory, and, 
therefore, could not have aided the recall of rule application skills. 

The expectation that the rule statement memorization groups would 
perform significantly better on a rule statement retention test than the 
group that did not memorize rule statements was partially supported. 
Those S^s memorizing rule statements either before or after the rule 
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application instruction outpe .•formed those who were not required to 
jnemorize rule statements* The S^s who were interrupted in their rule 
application inst<'Uct1on to memorize the rule statements may have found 
that this 1ntevri;pt'"o^ fnte'^fered with their- concentration in prevent- 
ing proper organization and storage of accompanying cueing mechanisms 
in memory for easy and accurate retrieval of the rule statements in 
the retention test s^tuat^'on « 

No signif icar.t t-edtrnent differences in transfer task performance 
were found. The t^^ansfer task used in this study did not include the 
presentation of rule statements, and, therefore, may not have been, 
similar, enough to'the or^'g^nai instructional program to cause the factor 
of rule statement memorization to have an effect on the transfer task 
performance. 

As expected, treatment effects within the rule application instruc 
tTonai program were consistent in favoring the memorization of rule 
statements prior to rule appl^cat^'on instruction, especially in the 
modules associated with the more difficult rules. The five APL rules 
used in the instructional program could be characterized as follows; 
Rules 1-3 were quite easy. Rule 4 was more difficult and quite complex, 
and Rule 5 was most difficult but straightforward. . The prior memoriza- 
tion of rule statements aided in reducing the number of sample test 
items required before reaching the minimum criterion performance for 
Rule 4, and in general reducing the amount of instructional display 
time and the amount of time required to respond to the sample test items. 
It seems that memorizing rule statements prior to rule application instruc 
tion enables the student to be more efficient in the acquisition of rule- 
governed behavior. However, this effect must be, tempered with the fact 
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that the total Instructional program including instruction in rule 
application skills and memorization of rule statements required, on 
the average, over twice the amount of time that the rule application 
skills instructional, program required by Itself. 

The expectation that the memorization of rule statements would 
reduce the relationships between task performance and reasoning ability 
as measured by the Ship Destination Test and the Letter Sets Test was 
not supported. The instructional program that required no memorization 
of rule statements- and the program that required memorization of rule 
statements prior to rule application instruction produced similar v^esults 
in minimizing the relationships between reasoning ability and performance 
in many of the instructional task measures and associated tests. The 
memorization of rule statements after meeting minimum criterion perfor- 
mance in rule-governed behavior Increased the relationship between reason- 
ing ability test scores and task, performance. Why this relationship was 
greater in the Rule Statement Memorization After group than In the No 
Memorization group is not clear. Apparently, the memorization of rule 
statements after mastery of rule-governed behavior may have little or, 
possibly, negative meaning to the student in the learning of rule-governed 
behavior, from an Information processing point of view, this memorization 
may provide additional information that is an unusable overload for those 
S^5 lower in reasoning abilUy, and which, in turn, debilitates both the 
acquisition and retention of rule-governed behavior. 

Memorization of rule statements during the rule application instruc- 
tion had no definitive effect on task performance or on the relationship 
between reasoning ability and task performance. As such, it should not 
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be used as an instruct lonai strategy for teaching rule application skills. 

Implications for Ru^e instruction 

The instruct Jo^ia^ problem of whether to require students to 
memorize rule, staterpent.s or not as a part of learning rule application 
skills cannot be concrus^ve!y solved on the basis of the results of 
this research. Hov/ever, several tentative suggestions can be made. 

1) If memu' '"zat -^cn of a rule statement is required -1n an instruc- 
tional prcgrdiv dGs'gned to teach rule appl"!cation ski'^ls, the 
memo/ izat ^or« ^-equv'ement shou)d be fu''.fiT!ed prior to instruc- 
tion rule application skills. 

2) If the goo-s of an instructional program are associated w^th 
only r.;le-go^e^ ned behavior in long- or short-term retention 
situatTcns, rnemO'^ ':zat:!on of rule statements is not necessary. 

3) if t.ctal ■ nstriKt vjna] time Is limited and all instruction 
must take p^ace during this time, memorization of ru^e state- 
ments should not be included in the instructional program, 

4) If some goals of an instructional program are associated with 
facil itating performance during the acquisition of rule- 
governed behavior, memorization of rule statements should be 
required prior to instruction in rule application ski"fls. 

5) If one purpose of the instructional program is to reduce 
learning ev-^ors and accompanying frustration and/or anxiety, 
memorization of rul ef statements should be required prior to 
instruction on rule application skills. 

The results of this study indicate that the instructional strategy 
used in developing the instructional program to teach rule application 



54 

skills was effective in producing appropriate rule-governed behavior. 
This strategy was based on the work of several educational psychologists 
and on the results of previous research by the author. The following 
seven instructional components are presented as being useful in pro- 
moting the acquisition of rule-governed behavior. 

1) Presentation of a statement explaining the purpose of the 
instruction and, in general terms, what is expected of the 
student during and after the instruction. 

2) Presentation of a statement of the rule to. be learned accom- 
panied by at least one example to show the student how the 
rule is correctly applied. 

3) (optional) Require the student to memorize the rule statement. 

4) Presentation of the rule statement and several examples for 
study by the student, followed by several problems requiring 
active student responses which are followed by appropriate 
feedback . 

5) Presentation o-^ the rule statement ana, without any examples, 
several new '^problems requiring student response followed 

by appropriate feedback. 

6) Presentation of se:vera] additional problems without support 
of either the presentation of the rule statement or examples 
followed by feedback- 

7) After several rules have been learned following the above six 
steps 5 the student should be presented with several problems, 
each requiring a different rule for solution to require the 
student to discriminate between learned rules snd to choose 
the appropriate rule to correctly solve the problem. 
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Implications for Future Research 

The instructional proeram used in this research produced such 
excellent results in enabling all subjectSj regardless of treatment, 
to exhibit appropriate >^u!e-governed behavior that the factor of 
memorization of rule statements may not have had the expected effect 
on retention of rule application skills. Research should be conducted 
using a less structured rule application instruction program to deter- 
mine 1f the memor^^zBt'-on of rule statements facilitate retention of 
rule application skills performance in a situation other than that of 
mastery learning such bs was used- in this research. 

The unexpected effect that was seen in the performance of Ss who 
memorized rule statements after mastering rule-governed behavior should 
be investigated furthe" to determine if the increased relationship 
between reasoning abi in.y and performance was caused by memorization of 
the rule statements of- memorization of any statement unrelated to the 
application of the ^^ule wou!d have the same effects Perhaps the memoriza- 
tion of the rule statement disturbs the v:ognitive organization of the 
already learned rule-governed behavior. Or the abrupt shift from learning 
a skill to learning verbal information may be the cause of this effect 
rather than the content of the material being memorized. 

The lack of the memorization of rule statement effect on retention 
of rule application skills may have been due to the relatively poor per- 
formance in retaining the rule: statements . Though performance on the rule 
application retention test and performance on the rule statement retention ' 
test were related (product moment correlation of .68) the rule statements 
may not have been accessible in memory to a great enough degree to aid in 
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retrieval of appropriate rule application skills, Reteaching the 
verbalization of rule statements immediately prior to a rule appli- 
cation retention test would assure that rule statements be available 
to aid in retrieval of previously learned rule application skills. 

The general izabi 1 ity of these results to instruction on rules 
in other than quantitatively oriented topics should be examined. 
Instructional programs using rules of grammar, rules of logic, or 
rules governing an athletic event might be appropriate to these further 
investigations of the effects of memorization of rule statements. 
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Note: Appendices are available upon request to: 

Computer Applications Laboratory 
1-A Tully Building 
Florida State University 
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